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Abstract. We consider a compact manifold X whose boundary is a 
locally trivial fiber bundle and an associated pseudodifferential algebra 
that models fibered cusps at infinity. Using trace-like functionals that 
generate the O-dimensional Hochschild cohomology groups we express 
the index of a fully elliptic fibered cusp operator as the sum of a local 
contribution from the interior of X and a term that comes from the 
boundary. This answers the index problem formulated in ju]|. We give 
a more precise answer in the case where the base of the boundary fiber 
bundle is S . In particular, for Dirac operators associated to a product 
metric of the form g x = ^ + + g F near the boundary {x = 0} 
with twisting bundle T we obtain 



Let X be a compact manifold whose boundary is the total space of a locally 
trivial fiber bundle ip : dX —* Y of closed manifolds. Let x : X — > R + be 
a defining function for dX, i.e. dX = {x = 0} and dx does not vanish at 
dX. One way to organize a (pseudo) differential analysis that reflects the 
geometry of X is to choose a Lie algebra V of vector fields on X, or more 
precisely a boundary fibration structure in the sense of Melrose @. The 
choice of the boundary fibration structure is by no means unique and differ- 
ent such structures on X require in fact completely different analytic tools 
- see, for instance, f| 0, ||, |n], [ll], |i~q| . In this paper we study the bound- 
ary fibration structure determined by the Lie algebra V$(X) of fibered-cusp 
or briefly <E> -vector fields where a smooth vector field V on X belongs to 
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in terms of the integral of the Atiyah-Singer form in the interior of 
X, and the adiabatic limit of the 77-invariant of the restriction of the 
operator to the boundary. 



1. Introduction 
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V$(X) provided V is tangent to the fibers of ip at the boundary and satisfies 
Vx G x 2 C°°(X). It is instructive to picture ^-vector fields in local coordi- 
nates. Let R + x M.™ x R™ be local product coordinates 
near the boundary such that y, z are coordinates in Y, respectively in the 
fiber F of (p. Then V € V$(X) can be written as 

n m 

V\u(x,y,z) = a(x,y,z)x 2 d x + ^ j b j (x,y, z)xd V] + ^ c k (x, y, z)d z 

3=1 k=l 

with coefficients a, bj, and smooth down to x = 0. Taking these co- 
efficients as local trivializations we see that the Lie algebra V$(X) can be 
realized as the space of smooth sections of a smooth vector bundle ®TX — > X 
that comes equipped with a natural homomorphism *TX — ► TX. 

The algebra of ^-differential operators is by definition the enveloping algebra 
DiffJ(X) of V$(X) over C°°(X). A corresponding <I>-pseudodifferential cal- 



culus ^>'^(X) has been constructed by Mazzeo and Melrose in [11]. First, $- 
pseudodifferential operators act canonically on C°°(X), but since DiffJ(X) 
as well as ^J(X) are C°°(X)-modules we can consider <3?-(pseudo) differential 
operators acting between sections of smooth vector bundles £,J r —>X over 
X and we write Diff|,(X; £, T) resp. *ff§(X]£,lF) for the corresponding 
spaces. Important examples of ^-differential operators are the Laplacian 
and the Dirac operators corresponding to exact ^-metrics, for instance (||) 
(see [11]; these are certain complete metrics on the interior of X which 
induce Euclidean metrics on ®TX). 

As in the closed <3?-pseudodifferential operator of order mo acts con- 

tinuously as an operator of order mo on a scale of &-Sobolev spaces 
s € R. The <I>-pseudodifferential operators A that induce Fredholm oper- 
ators — > H^~ p have been characterized by Mazzeo and Melrose |11] as 



being those operators with invertible principal symbol as well as invertible 
normal operator (see Section ^). Such operators are called fully elliptic. The 
index of a fully elliptic operator A is independent of the particular s € R. 
A preliminary index formula for fully elliptic operators has been obtained 
in H under the assumption that £ = J- (this assumption is no restriction 
when a fully elliptic operator exists; an isomorphism £ —> T is given by the 
principal symbol of the operator applied to a non-vanishing <3?-vector field, 
which exists whenever dX ^ 0). 

Let us briefly recall the index formula. We need several trace-like functionals 
on the ^-calculus whose definition has been adapted from a similar context 
in (T^j. Let Q £ *f>$(X) be a positive self-adjoint fully elliptic operator and 
Q~ x € Vl/$ (X) the family of complex powers constructed as in ||. Then 
for A € ty$°(X), the operator x z AQ~ x is of trace class for Re(z) > n + 1 
and Re(A) > mo + dim(X), and the map (A, z) i— > zATr x z AQ~ x admits a 
meromorphic extension to C 2 which is analytic near (z, A) = (0, 0); thus, we 
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can define 

z\Trx z AQ- x =: Tr 9 ^(A) + \Tr d (A) + zTr a (A) 

+\ 2 W{\, z) + XzW'(X, z) + z 2 W"(\, z) , 

where the error terms W, W, W" are holomorphic near OeC 2 . The func- 
tional obtained in this way have been studied in ||. 

Theorem 1 ([§). Let A G *^°(M,£) be a fully elliptic ^-operator. Then 

index A = Tr a (A[B, log Q]) — Ttq([A, log x]B) 
where B £ ^~^ P {X) is any inverse of A up to trace class remainders, and 

[5,logQ] := -^(Q- X BQ% =0 €^ P (X,£); 

[logx,A] := ^-(x z Ax-% =0 ex%-\X,£). 

Formally this is the same simplification of the computation of Melrose and 
Nistor as in 0, ||. From we know already that the first contribution 
to the index is local, i.e. does not change if we modify A by an operator 
of sufficiently negative order, whereas the second contribution is global but 
depends only on the behavior of the operators at the boundary, i.e. it does 
not change if we modify A by an operator that vanishes to sufficiently high 



order at the boundary. We identify in Proposition 12 the local term in 
Theorem [l| with the regularized Atiyah-Singer integral for the index, defined 
in terms of heat kernel asymptotics. 

Our main interest lies in the case where the base Y of the fiber bundle 
(p : dX — > Y is the circle S 1 , for first-order differential operators A modeled 
on Dirac operators. Choose a connection in the boundary fiber bundle, 
that is a rule for lifting the horizontal vector field dg. Choose a smooth 
metric on the interior of X that with respect to a product decomposition 
dX x [0, 1] C X close to the boundary looks like 

, . y dx 2 d6 2 p 

(1) 9 =1^ + 1^ + 9 



where 9 is the variable in the circle and g is a family of metrics on the 
fibers. Such a metric is called a product ^-metric; it induces an Euclidean 
metric on the vector bundle *TX. Assume moreover that S\ 9X = E + @E- 
and fix Hermitian metrics and connections V in 

Theorem 2. Let £, T — > X be Hermitian vector bundles and let 

A : C°°(X,£) -» C°°{X,F) 

be a first- order differential operator which in a product decomposition dX x 
[0, 1] C X, S m = E + @E- looks like 



(2) A = a [ (x 2 x - -)J 2 + 



x . 



-ixV dg D* 
D ixV 9lj 
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where D is a family of invertible operators on the fibers ofip, D* is the formal 
adjoint of D, a is an isometry £\qx —> F\dX> an d ^ 'dg := ^d e + i r ^ r (Ld g g F )- 
Then A is Fredholm as an unbounded operator on L 2 (X,£,J-,g x ) and its 
index is given by 

inde X (A)=A^(A)- 1 ^^. 

Here AS (A) is the integral on X of the pointwise supertrace of the heat 
kernel of A, which is a local expression in the full symbol of A and in the 
metric, while lim a n(5 x ) is the adiabatic limit (the limit as x tends to 0) of 
the eta invariant of the "boundary operator" 

-ixV 9e D* 



D ixV dg 



: C°°(dX,£) -> C°°(dX,S). 



Note that we do not need to actually construct the heat kernel of A in order 
to define the local index density. This density is slightly less than L , see 



Proposition 17. It is instructive to compare this result with the classical 
Atiyah-Patodi-Singer index formula (p. 

Corollary 3. Let (X,g x ) be a compact spin manifold with boundary and 
T — > X a Hermitian vector bundle with constant metric and connection 
near dX . Then the twisted Dirac operator A on (X, g x ) is of the form (|2|) . 
Moreover, A is Fredholm on L 2 (X, £, J-, g x ) if and only if the family D of 
Dirac operators on the fibers is invertible, and 

lim a 77(<y 



index(vl) = / A(X) ch(T) 
Jx 



This follows immediately from the local index theorem (see Q ) and Theorem 
||. One checks directly in this case that the curvature of g x is a smooth 2- 
form on X with values in End(*TX) so A(X) ch(T) is a smooth form on X, 
thus in L 1 (see Proposition O). 



Corollary 4. Let A be as in Theorem ^. Then the integral of the index 
density is an integer if and only if the determinant bundle of the boundary 
family D has trivial holonomy. 

This is a trivial application, since the adiabatic limit of the eta invariant 
equals the logarithm of the holonomy (see Section |2| for the definitions). In 
particular, under the assumptions of Corollary || the Atiyah-Singer volume 
form defines an integral cohomology class. 



A related index formula has been obtained by Nye and Singer [19] for the 
spin Dirac operator on X = S 1 x M 3 where the boundary fiber bundle is the 
projection S 1 x S 2 — > S 2 . In the general case Vaillant |2(J gave a formula 
for the index of the Dirac operator of a ci-metric on manifolds with fibered 
cusps. Vaillant 's formula contains the adiabatic limit of the eta invariant 
in the form computed by Bismut and Cheeger S. It seems therefore likely 
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that Theorem || continues to hold for boundary fiber bundles with higher 
dimensional base, as conjectured in [pTs| ] . 

The paper is structured as follows: in Sections we recall results about the eta 
invariant of self-adjoint operators. Section y is devoted to an introduction 
to fibered cusp pseudo differential operators, with a focus on traces. The 
index theorem |l] is reviewed in Section |j. Finally the proof of Theorem § 
occupies Section ||[ A curious feature of the proof is the appearance and 
then cancellation of the integral over S 1 of the determinant of D*D in the 
boundary term of the index formula. 



Acknowledgments: The authors are indebted to Richard Melrose for 
drawing their attention to the fascinating world of pseudodifferential alge- 
bras associated to boundary fibration structures. His patience and generos- 
ity have been of invaluable help for us. The first named author is grateful 
to Michael Singer and Boris Vaillant for some private lectures on the <3?- 
calculus. 



2. Review of eta invariants and adiabatic limits 

The eta function of an elliptic self-adjoint differential operator 5 was defined 
by Atiyah, Patodi and Singer |lj as 

r]{5,s) := Tr ({5 2 y^8^J . 

(assuming that 5 is invertible). 

Consider the family of operators on C°°(dX, £) defined for < x < oo by 

5 . \ ~ixV de D* 

[ D ix^de . 

where D is a family of elliptic invertible first-order differential operators on 
the fibers of dX, acting from E + to E~ . 

Lemma 5. The operator 5 X is symmetric on L 2 (dX,£,£, + g F ). 
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Proof. We must show that Vg g is skew-symmetric. Let si,s 2 G 
C°°(dX,£). Then 

(Va e si,s 2 ) + (si,Vd e s 2 ) 

= [ f (Va fl «i, s 2 ) + (si,V dg s 2 )) dg F dO 
Jax v ' 

= [ (d e (s 1 ,s 2 ) + ^^-Tr(L d9 g))dg F d9 
Jax 1 

Ld e ({s 1 ,s 2 )dg F )d9 

ox 

(si,s 2 )dg F )d0 = O. 
dX/S 1 J 

□ 

We will see in Section [| that 5 X is also invertible for small enough x > 0. 

The eta invariant of S x is by definition the regularized value of n(5 x ,s) at 
s = 0. In fact, the eta function is regular at s = (see M). By the adia- 
batic limit, denoted lim a r)(S x ), we mean the limit lim x ^Q r](S x ). Intuitively 
it corresponds to separating the fibers of dX — > S 1 in the limit since the 
Riemannian distance between distinct fibers tends to infinity. 

Recall the definition of the determinant line bundle of the family D with 
the Bismut-Freed connection. Since D is invertible, det(D) is defined as the 
trivial bundle C x S 1 — > S* 1 with the connection d + qj bf (Q), where uj bf (0) 
is the finite value at s = of the meromorphic family of 1-forms 




Clearly, the holonomy of the Bismut-Freed connection is 

hol(det(,D),cu Bi? (0)) = e -^ SF (°). 
We define the logarithm of the holonomy of det(D) as 

(3) loghol(det(D)) = - / to BF (0) G tSL 

Js 1 

Determinant bundles and eta invariants are linked by the global anomaly 
formula of Witten [21], initially proved in [Ejj for Dirac operators. The 
general result that we need is taken from [17, 18 1. 

Theorem 6. The adiabatic limit of the eta invariant of 5 X satisfies 
\im a r](5 x ) = -— log hol(det(D)). 

ITT 
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3. The fibered cusp calculus of pseudo-differential operators 



In this section we introduce the basic facts about the fibered cusp calculus 
from H that are used in the next sections. For a thorough treatment of the 



fibered cusp calculus we refer the reader to [11, £C]]. We continue to use the 
notations from Q. 

Blowing-up a submanifold N of a smooth manifold M means replacing N 
by the set of its real normal directions inside M, i.e. the sphere bundle of its 
normal bundle; this procedure is equally defined for manifolds with corners. 
The result of the blow-up is a new manifold with corners of codimension 
possibly higher by 1 than those of the initial manifold. 



3.1. The construction of ^-operators. Let 

Xl := [X x X; dX x dX, {dX) 2 v x {0}] 

be the fibered-cusp double space, obtained by an iterated real blow-up from 
X 2 as follows: first blow up the corner dX x dX (at this stage we get the 
celebrated 6-double space X?). The new boundary hyperface introduced by 
this blow-up is diffeomorphic to dX x dX x [—1,1] under the following map: 
the class (modulo R+) of the non-zero normal vector (Vi, V2) at (2/1,2/2) maps 
to ^fep^fey - Thus dX x 8X x {0} is a well-defined submanifold of X 2 
provided we fixed the boundary-defining function x. The second stage of 
the construction involves blowing-up the fiber diagonal 

{dX)% :=8Xx v dX = {(p, q) € dX x 8X; <p(p) = <p(q)} 

of the boundary fiber bundle which by the discussion above is also a sub- 
manifold of X 2 . The space X| comes equipped with a canonical smooth 
structure as a manifold with corners of codimension at most 2, and with a 
smooth blow-down map 

(3 : X% -» X 2 

which extends the identical diffeomorphism (X^)° = (X 2 )° of the interiors. 
The last face introduced by blow-up is called the $-front face, denoted ff$. 
The lifted diagonal A$ is by definition the closure in Xl of the preimage 
under (3 of the interior of the diagonal in X 2 . 

The motivation of the construction is the fact |jLT] , Corollary 1] that the 
space of ^-differential operators is canonically isomorphic to the space of 
distributions on X| supported on A$ , conormal to A$ and extendable across 
ff$, with values in the bundle !FM £ * (gi £1'. Here is the pull-back through 
the projection on the right factor of the <I>-density bundle Q(®TX). Note 
that 

c°°(x,n(*TX)) = x- dim ^- 2 c°°(x,n(TX)). 

This singularity of order dim(y) + 2 will play a great role in the rest of 
the paper. In fact, the main reason for assuming Y = S 1 in Theorem [2] is 
making this order of singularity small. One defines then [O] fy^ (X) as the 
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space of linear operators A : C°°(X,£) — > C°°(X, J-) such that the lift ka 
of the Schwartz kernel kA to Xl is a classical conormal distribution of order 
mo on X^ with values in £* M T ® W, vanishing rapidly to all boundary 
faces other than ff$ and extendable across ff$. These operators extend to 
bounded operators between appropriate <3?-Sobolev spaces. The fibered cusp 



calculus is closed under composition [jll|, Theorem 2]. 



If tp is the identity map, fibered-cusp operators are nothing else than scat- 



tering operators [12|. In that case the identifier $ for double spaces, tangent 



bundles etc. will be replaced by sc. 



3.2. The normal operator. There exist two symbol maps on both 
multiplicative under composition of operators. One is the usual conormal 
principal symbol (living on *T*X). To describe the second symbol TV, called 
the normal operator, first assume that Y = S . In this case the interior of the 
$-front face ff$ is the total space of a trivial 2-dimensional real vector bundle 
over (dX)p. The two real directions correspond to the normal direction to 
dX in X, and to the normal direction to (cX) 2 inside dX x dX. Then J\f 
is obtained by "freezing coefficients" at ffcj> and then Fourier-transforming 
in the two real directions: 

AT (A) := ^a~\Z- 

Note that in the general case there are diml" + 1 suspending variables. 
This new symbol map J\f surjects onto the algebra ^f us (*jv*Y)-v^'^ °^ 
families of classical pseudo-differential operators on {Z p x M 2 } peS i invariant 
with respect to translations in M 2 (2- suspended operators in the terminology 
of [|l4j]) where Z p is the fiber over p € S 1 of the boundary fiber bundle 
tp : dX — > S . An operator A in &$(X) is called elliptic if its principal 
conormal symbol is pointwise invertible, and fully elliptic if, in addition, 
the corresponding normal operator M(A) consists of a pointwise invertible 
family of pseudo differential operators. 



3.3. The formal boundary symbol. The principal symbol and the nor- 
mal operator are invariantly defined. As for standard pseudodifferential 
operators there exists a more refined notion of formal symbol map, associ- 
ating to an operator the Laurent series of its full symbol at the sphere at 
infinity inside the radial compactification ®T*X (however, this symbol de- 
pends on choices except for its first term, the principal symbol). Similarly, 
we associate to an operator its formal boundary symbol 

(4) q:9*(X)^9j aieN . Y) _ ip (dX)[[x]]. 

To construct q, first choose a product decomposition dX x [0, e) <^-> X of 
X near dX so that x(y, t) = t. Let X t be the image of this map, and 
Y e := Y x [0, e). Thus X e fibers over Y t via tp x Id with fiber type F and 
(X e ) 2 fibers over {Y e ) 2 sc with fiber type F x F. 
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Lift through (3 the diagonal embedding (dX)^ x [0, e) > X 2 to an embedding 

(5) (dX)lx[0,e)^Xl 

Note that (dX) 2 v x {0} maps identically to itself as the zero section in ff$. 
Moreover, the image of (||) is exactly the preimage of A sc under the fibration 

(6) PQ1 - (Y e ) 2 sc . 

Thus the normal bundle to (dX) 2 ^ x [0, e) inside X^ is the pull-back via 
@ of the normal bundle to A sc , which is canonically isomorphic to sc TY e . 
Consequently we use the notation N((dX) 2 x [0,e)) = sc TX e . The total 
space of sc TX e \ x= o coincides with the interior of the front face. Construct a 
collar neighborhood map /i : sc TX e <^-» X^ which on ff$ is the identity. Take 
a ^-operator A and pull back its lifted Schwartz kernel ka from X 2 , to the 
total space of sc TX e using /i. Note that n*(£l') = ftfiber,R ® 7T*(0( sc TF e )) is 
the tensor product of the density bundle in the second factor of (dX) 2 and 
the pull-back of the scattering density bundle from Y e . At the zero section 
in sc TX t we can identify the scattering density factor with an Euclidean 
density on the fibers of sc TX e (this density will alow us to take Fourier 
transforms in the fibers). Identify £,J- and sc TX e with their pull-backs 
from the zero-section of the front face, take the Taylor series of /j>*(ka) at 
x = (we can differentiate with respect to £ a distribution conormal to 
A-dx x [0, e)ic) and then Fourier transform the coefficients in the fibers of 
sc TX e . This defines the map q. 

3.4. Product on formal boundary symbols. The formal boundary map 
q depends on choices of connections and trivializations except for its lead- 
ing term which is just the normal operator. We denote by * the product 
induced by q on NtY ^_^(dX)[[x]]. Recall that in the standard pseudo- 

differential case we can choose the formal symbol map so that the induced 
product on formal series of homogeneous symbols (the so-called star prod- 
uct) takes the form 

a(y, * Hy, = a(y, OKv, + \ % a ^' + • • ■ 

Similarly in the context of Theorem [2] we can choose the formal boundary 
symbol map q with the properties: 

(7) q(xV d9 ) = ir 

(8) q(x 2 d x ) = it 

q(P) = P 

where r is the suspending variable cotangent to the base S 1 of the boundary, 
£ is the suspending variable conormal to dX in X and P is a fiberwise 
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differential operator which is constant in the fixed product decomposition 
near the boundary. 

Lemma 7. For U,V € ^f us («jv"*Y)- ^(^OtMl; ^ e V r °duct induced by q 
takes the form 

(9) tr , v = pv + _ + T _ j + 7 _V 8 „(F) + 0(A 

where the product in the right-hand side is the standard product of power 
series with coefficients in the algebra ^f us (4> jv*y)_(p(^0 ' 

Proof. It is enough to prove the formula for "^-differential operators since 
the product is given by bi-differential operators with polynomial coefficients 
(see e.g. |9|, Proposition 3.11] for details of this argument in a similar con- 
text). But Diff$(X, £) is generated near dX by ixVg e , ix 2 d x and by differ- 
ential operators along the fibers. The lemma follows easily from (0) and (||) 
since it is valid on the generators. □ 

3.5. Traces densities of ^-operators. Of main interest for us are traces 
of ^-operators. We study them using the more refined notion of trace 
density. It is a standard fact that on a closed manifold M, any operator 
A € ^ A (M, £) with Re(A) < - dim(M) is of trace class, and 



Tr(A) = I tr(fc A | A ) 
J A 



(the Schwartz kernel fc A is continuous on M x M and its restriction to the 
diagonal is a smooth 1-density with values in End(£)). The same remains 
true for ^-operators modulo an integrability issue at the boundary. By 
pulling-back via the blow-down map we write 



11(A) = f tr(K A |A») 



We identify A$ with X via the right projection. The restriction to A$ 
of the density bundle tt' is precisely Q^TX) = x~ dim ( y )~ 2 0(X). It is 
then clear that A is of trace class if and only if A £ x z ty^(X, £) with 
Re(z) > dim(y) + l,Re(A) < — dim(X). The density tr(K A |A$), viewed as 
a density on X, is called the trace density of A. 

Recall that for the definition of the formal boundary symbol we have chosen 
a product decomposition of X near dX, as well as a local isomorphism of 
£ with its pull-back from dX. We can thus expand ka\a^ in powers of x 
near x = 0. Let ®NdX be the restriction of the vector bundle sc TX e to 
dX x {0} C ff$ and *N*dX its dual. 

Proposition 8. Let A £ x z ^(X,£) with Re (A) < -dim(X). Then 

. dim(Y)+l 

1 / , .s Use 



ka\a, (27r)dim( y )+1 J* N * dX/9x q{A \dim(Y) + I)!" 
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Proof. This is precisely the Fourier inversion formula in each fiber of 
®NdX, where ui sc is the canonical (singular) symplectic form on sc T*Y e 
pulled back to ®N*dX. □ 

In the case Y = S 1 this takes a somewhat simpler form. 

Corollary 9. Let A € x z ^(X,S) with Re(A) < - dim(X) and assume 
Y = S 1 . Then 

1 f , .,, , ,.\ d6dx 



ka\a* ~a^o ((2~)I 9{-A)(T,i)drdA 



Proof. Notice that ^NdX is a trivial M 2 bundle in this case, while u 
7? 



d£f\dx _|_ drAdd rj 



If C 9 A ^ -4(A) £ ^$C^>£) is an entire family of ^-operators then both 
k a|a s and q(A)\® N*dX extend meromorphically to C with at most simple 
poles. Moreover, Corollary |9| remains valid for the meromorphic extensions 
for all values of A (at a pole, the expansions are valid for the residues and 
for the regularized parts separately). 

We close this section with a description in terms of the map q of the trace 
functional Ttq defined in the Introduction (compare with [||, Proposition 
7.6]). 

Lemma 10. Let A E ^^°(X). Then Ttq(A) is explictly given by 
^d(A) = -^r ( [ Tr(q(AQ- x ) { _ 2] )dedrdA 

where Tr in the right-hand side denotes the trace of operators on the fibers 
of ip : dX — > S l , (-)ny is the coefficient of x~ k in a power expansion in x, 
and (-)a=o stands for the regularized value at A = 0. 

Proof. We can assume that k A q-x is supported in (X e )|. Then 



Tr d (A) = Res 2=0 Tr(x z AQ- x ) 



A=0 



Res z=0 / tr(K xZAQ -x) lx=0 

Res z=0 / / x z tr(K AQ -x)ix=o 
JO JdX 



Obviously, 

Res 2=0 f / x z ~ k dx 



o 
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equals 1 if k = 1 and otherwise, so 

Tr d (A) = ([ tr(K AQ ->) {1] ) 

\JdX J |A=0 

(we used Corollary ^ and the remark following it in the last equality). Now 

/ tTq{AQ-\_ 2] =Tv(q(AQ- x ) { _ 2] ) 
Jax/s 1 

so the result follows by Fubini's theorem. □ 

4. The abstract index formula 

The results of this section hold for general boundary fiber bundles, i.e. not 
necessarily with base S . 

Fibered-cusp operators have two types of principal symbols. Accordingly, 
elliptic regularity has a new aspect in fibered-cusp theory concerning regular- 
ity at the boundary. The following lemma and its proof are quite standard; 
we include them for future reference. 

Lemma 11. Let A G S&$(X, £ , T) be fully elliptic. Then the L 2 solutions 
ofAip = belong to x°°C°°(M, £). 

Proof. Since A is fully elliptic there exists a parametrix B of A inverting A 
up to R € x 00l i r ^° (X, £). Let ip be a distributional solution of the pseudo- 
differential equation Aip = 0. It follows 

= BAip = (J + R)ip = ip + Rip 

so %b = -Rtp. But R e x°°^l°°(X, £) implies Rip € x^C^M, £). □ 

Since R is compact on L\ (the compact operators in ty^(X) are precisely 
those in x^^ 1 (X)) it follows that ker A is finite dimensional and moreover 
the orthogonal projection Pker A belongs to the ideal x 00 ^ / ^ 00 (X, £). We can 
define therefore invertible ^-operators 

Ql := (AA* + P kcrA *) 1/2 ; 
q 2 .- (A*A + P kexA ) 1 / 2 . 

Note that q(Q 1 ) = q(AA*) 1 / 2 . Let 

B := A*Q^ 

be a parametrix of A. 
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4.1. The index formula. Let us reprove the index formula from ||. As- 
sume for simplicity that A is of order 1. For technical reasons we would 
like to work with operators acting from £ to itself. Recall that dX ^ 
implies the existence of a non-vanishing vector field on X (the obstruction 
to the existence of such a vector field lives in iJ dim W and this space is 
when dX ^ 0). There exist non-canonical isomorphisms between TX, 
®TX and ®T*X, and thus a non- vanishing section in *T*X. The princi- 
pal conormal symbol of A evaluated on this section gives an isomorphism u 
between £ and T . Finally, v := u*{uu*)~ 1 / 2 is an isometry J- — ► £. Thus 
U := vA G ^\(X,£) has the property 

R 1 :=(UU* + P kciU *) 1/2 = vQiv* 

R 2 : = {U*U + P kciU ) 1/2 = Q 2 . 

Set V := Bv*. Note the commutations UR 2 X = R^ X U, VR^ X = R^ X V '. 
The index formula is obtained as follows: 

index(A) = index(C7) 



(§.1) 



(0.2) 



Tr(UV - VU) 

Tv(x z {UV - VU)R 2 X ) X=0 , Z=0 

Tr(x z UVR 2 x - Ux z VR^ x ) x=0 , z=0 
Tr(x z UV{R 2 x - R± x ) + [x z , U]VR^ 



jA=0,2=0 



(Tv(x z (R 2 x -R^)) 



A=0,z=0 



(10) + Tt([x z ,A\BQ^ x ) x=0 , z=0 . 

For (0.1) we have used the fact that Tr[C,L>] = for C G x c ^%(X), 
D G x d ^%{X) with a,b,c,d G C, Re(a + b) < -dim(X), Re(c + d) > 
1 + dim(y). Thus (|To|. 1) is true for large real parts of X,z, hence for any 



X,z G C by unique continuation. (10,2) holds at A = 0, z = because 



UV — 1 G x°° x I , (I) 00 (X) while v,v* cancel in the trace. 

4.2. The interior term. We claim that the first term in © is the regu- 
larized integral on X of a local expression in the full symbol expansion of U. 
Indeed, for j = 1, 2 let r,-(A) G C°°(X, End(£)<g>*n(X)) be the meromorphic 
extension of the lifted Schwartz kernel k„-\ restricted to A<j>. As in the case 

of closed manifolds it is easy to see that rj(\) is regular at A = 0. The first 
term in (|i~0| ) is J x x z tv(r2(0) — r*i (0)) | 2 =o- By Corollary |9| and the remark 
after it, the density tr(r2(0)) has a Laurent expansion at x = starting with 
x~ 3 so the previous integral is absolutely integrable and holomorphic in z 
for Re(z) > 2 and extends to C with possible simple poles at z = 2 — N. 
Now 

R 2 X -R^ X = U[R 2 x ,V} + 0(X)x 00 ^- 00 (X) 

= XU[V, log R 2 }R 2 X + 0(X)x 00 ^ 00 (X) + 0(A 2 ) 
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where 0(A) denotes an analytic multiple of A near A = 0. Clearly then 

(11) (Tr(x z (R 2 x - R- X )) x=0 ^ z=0 = Tr a (U[V,logR 2 ]). 

On the more refined level of trace densities, by |], Proposition 7.4], 

r 2 (0) - n(0) = — ^ / a [ _ N] (U[V,logR 2 ]) ln ^ 
(27rj JV J* s *X/X 

is given in terms of the component of homogeneity — dim(X) of the formal 
symbol of U[V, log R 2 ], so clearly depends only on the jets of the full symbol 
of U. 

4.3. The boundary term. Similarly for the second term from (^) we 
have 

[x z ,A]B = zx z [log x,A]B + 0{z 2 ) 
and Tr(0(z 2 )) = O(z) so 

(12) Tv([x z ,A]BQ^ x ) x=0iZ=0 = -Tr d ([A,logx]B). 



By Lemma 10 this last quantity is concentrated at the boundary. 



So far, combining (|To|), (|TT ) and (|l~2] ) we have proved the general index 
Theorem |]. Note that in (|n) we can assume v = 1 (and so U = A, V = B, 
Q = R 2 ) since in Theorem [l we suppose £ = T. 

4.4. Relationship with heat kernel expansions. Here is a more familiar 
interpretation of the local term (|ll|). It is worth stressing that we do not 
prove a heat kernel expansion for A* A. Rather we use the existence of heat 
kernel expansions for pseudo-differential operators on closed manifolds as 
well as the locality of the two quantities we want to relate. 

Proposition 12. The local quantity tr(r2(0) — ^i(O)) equals the index den- 
sity, defined as the universal expression in the jets of the full symbol of U 
which gives the pointwise supertrace of the constant term in the heat kernel 
expansion. 

Proof. Fix a point p in the interior of X and modify the operator U far 
from p so that it extends to an elliptic operator on the double of X. Denote 
the extensions to 2X by the same letters as before. Then for j = 1,2 use 
the Mellin transformation formula 

POO 

T(X)Rf x = / t x - l e~ tR Ut 
Jo 

to identify the value at A = of the analytic extension of the Schwartz kernel 
of RJ X on the diagonal with the coefficient of t° in the asymptotic expansion 

— tR 2 

as t \ of the Schwartz kernel of e i on the diagonal. Remember that 
R2 = Q2, and observe that Q\ and R\ are conjugate via v so the pointwise 
trace of their Schwartz kernels is the same. □ 
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Such a formula for the local term is not surprising in index theory. Our 
point is getting it without having to construct heat kernels for ^-operators. 
In this respect the approach via complex powers, which are already objects 
in the calculus, presents a great advantage. 



Although the local term ( |ll|) is smooth on X up to the boundary as a $- 
density, its integral might in principle diverge since as an usual density on X 
it has a singularity of order 3 at x = 0. Thus, we cannot set directly z = in 
the above evaluations. To prove Theorem || we must identify the boundary 
term with the adiabatic limit of the eta invariant and show that the index 
density is integrable in a restricted sense. We will do this in Section || 

However, we can prove directly that when A is a twisted Dirac operator 
corresponding to the metric g , and with twisting bundle T with metric 
and connection constant in x in a neighborhood of the boundary, the local 
term in the index formula equals the integral of the Atiyah-Singer density 
A(X, g x ) ch(T) without regularization. Indeed, 



Proposition 13. The Riemannian curvature R of(X, g ) induces a smooth 
2-form on X with values in End(*TX) down to x = 0. Thus A(X,g x ) and 
ch(T) are smooth forms on X . 



Proof. Let e\, . . . , e m be a local orthonormal frame in the fibers of eft. It 
is straightforward to compute R(g x ) using the local orthonormal <£-vector 
fields x 2 d x , xdg (lifted to dX using the connection involved in the definition 
of g x ), ei, . . . , e m . We observe that while for instance R(d x , ei)de diverges 
like 1/x as x — > 0, the induced action of R on *TX is smooth down to 
x = 0. To conclude that A(X,g x ) is smooth it is enough to prove that 
tr(R k ) is smooth down to x = for all k 6 N. Of course it does not matter 
for the trace if we view the 2-form R as acting on TX or on ®TX, so the 
conclusion follows. ch(T) is obviously smooth in x (it is in fact constant in 
x in a neighborhood of x = 0). □ 



5. The index of first-order ^-differential operators 

For the rest of the paper we assume that Y = S 1 and that A satisfies the 
hypothesis of Theorem @. Note that x 2 d x — x/2 is skew-symmetric with 
respect to the metric g . It follows directly from the properties of the 



16 



ROBERT LAUTER AND SERGIU MOROIANU 



quantization q that 



(13) 
(14) 

(15) 
Set A. 



q(A) 
q(A*) 
N{AA*) 
q(AA*) 



t 2 + D*D -ixV 9f) (D*) 
ixV dg (D) t 2 + DD* 

i£ - § + r D* 
D % - f - r 

z£ + f + r -D* 
-D -»£ + f - t 

£ 2 + r 2 + D*D 
i 2 + r 2 + 

£ 2 + r 2 + L>*L> 
£ 2 + r 2 + 

i£ + r -iVfl,(£>*) 



a 



x 2 

+ T 



(7 



D*D, A_ := DD*, A := 








A_ 



Lemma 14. The operator A defined by @ is a fully elliptic ^-operator if 
and only if the family D is invertible. 



Proof. It is clear from (|3|) that M(AA*) = ct(£ 2 + t 2 + A)a* is elliptic and 
non-negative as a 2-suspended operator; moreover it is invertible for each 
value of the parameters r, £ € K (thus invertible as a suspended operator, 
see (T^j) if and only if D is invertible. □ 

Lemma 15. [17, 18 1 The differential operator 5 x G Diff 1 (3X,£^) is invertible 
for < x < e for some e > 0. 

Proof, (sketch) We can view S x as an adiabatic family of operators (i.e. an 



adiabatic differential operator in the sense of [1 
operator of this family is invertible as in Lemma 



The adiabatic normal 
14j , so exactly like in Lemma 
11 there exists an inverse \x x G i f?~ 1 (dX,£) modulo x co ^~ ao (dX , £ ): 

5xHx = I + r x 

Now the residual adiabatic ideal x 00 \I'~ 00 (<9X, £ ) equals the space of rapidly 
vanishing families of smoothing operators on dX as x — > 0. Thus r x — > 
inside bounded operators as x — > 0. The conclusion follows for e chosen 



small enough so that 



< LVx < e. 



□ 



Proposition 16. T/ie boundary term Trg(L4, log /rom i/ie index for- 
mula ( |To| ) equals — ^ log(hol(det £))). 

Proof. From (Q) we know logx]) = xcx. We claim that we can 
assume a = 1. Let 5,T 6 C°°(X, End(£)) C #£(M,£) be such that q(S) = 
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Tr(x 2 L4,log x]BQ^ x ) = Tr{x z ST[A, log x]BQ^ A ) + O(z ) 

= Tr{x z T[A, log x]5Q^ A ,S) + 0(z°). 

Observe that q(T[A, log x]) and q(BQ^^S) do not contain a anymore; on 
the other hand the term regular in z at z = does not affect the residue, 
which proves our claim. From Lemma [lG, 

TY 9 (L4,logz]5) 
= TTw I Tr(g([Alogx]BQr A ) h2] )dT^| A=0 

(16) = / TV (g(^(^4*)-7-i) hl] ) drd^| A=0 

where we use the formulas (0), @||) for <?(A*), g(^L4*) with a = 1. There 
are three types of terms occurring in (|l6|) as explained below and we write 
accordingly 

TV 9 (L4,logx]£) = (/(A) + 77(A) + 777(A)), A=0 . 



5.1. The terms of type 7. First there are those terms where </(^4*) and 
AA((^4vl*) _A / 2_1 ) are composed according to the product rule @. Since 
dq< 0^ - and - are constants, the corresponding integrands are exact 
forms so the terms containing them vanish. The non-vanishing terms of 
type 7 come from § M{{AA*)- X / 2 - 1 ) and dU{AA*) ^ Uging q &nd 

polar coordinates in the (r, £ ) plane we get 



/ -TrfAA(^*)- A / 2 - lN )dWr(ie 
[ — f Tr( A~?) d6. 

t\ /el V / 



(17) = sx/* 

Thus at A = we get the average of the logarithm of the determinant of the 
family D. Although in the end this term will cancel away, it is worth recalling 
the definition of the determinant of A, not to confuse with the determinant 
line bundle with connection (det D,d + lo bf ) defined in Section ||. The zeta 
function of any positive pseudo-differential operator is regular at A = 0; the 
logarithm of the determinant of A is defined as the derivative C'(A, 0). This 
derivative clearly equals the finite part at A = of —4 Tr(A~2"). 
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Similarly we get 

J 2 A = / TV - dOdrdi 

(27ry J s i xR2 \i d£ dr / 



(2k) 



^2/ Tr(r 2 +^ + A)- 



l d8drd£ 



A 



(in (p!8[l) we used the formulas ( |13D and ( |14D with a = 1 while in we 
used polar coordinates in the (r, £) plane). 



5.2. The terms of type iT. The second type of terms in ( |lq ) come from 
the coefficient of x in (£ 2 + r 2 + A) ^ 1 , where the power is taken with re- 
spect to the product (||). This diagonal matrix is not explicitly computable, 
however the trace of Af(A*) times it is, because of two facts: 

• The diagonal of M(A*) is made of central elements modulo x. 

• The partial derivatives of £ 2 + r 2 + A with respect to £ and r, are 
central elements in Vl/§(X) /x°°^^(X) modulo x. 

Thus we can compute Tr ^J\f(A*)(^ 2 + r 2 + A)j_^ 2 ^ as if all the operators 
involved commute: 

//(A) = 7^/ TrfNiA^e + rZ + AVf-^dTdedt 

Tr [ ( -i£ + r 



1 



S 1 xl 



1 

-1 



1 + 1) (| + 2) 



2 



(27T) 



integration. The term containing 



Vg 9 (A) is also seen to vanish 



We first eliminate the terms which are odd in £ or r and thus vanish after 

1 
-1 

because the traces on E + and E~ cancel each other. We are left with the 
term containing — 4£ 2 t 2 . 

um = 4 (i + i) (i + a 



(2tt) 2 2 

£ 2 r 2 Tr(£ 2 + r 2 + A)-?~ 3 dTd£d0 



S l xR 2 

(19) = -±-J Tr(D*D)-$M. 

(we integrated by parts in r and £ and then used polar coordinates in the 
plane (r,f).) 
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cient of x in q(AA*), i.e. the matrix x 



. Again, it 



5.3. The terms of type III. These are the terms coming from the coeffl- 

iV de (D) 

is impossible to compute these terms before taking the trace, however the 
other two factors involved commute (modulo x) so the trace behaves as if 
all operators involved commuted. We get the following contribution to (Fjl 



III(X) 



A 
2 



1 



1 



(2vr)< 



Tr 



S 1 xl 



-i£ + t D* 
D -i$-r 



i 2 + t 2 + D*D 

i 2 + r 2 + DD* 



ii + r -iV dg (D*) 
iVg e (D) ii-r 



drd^cie. 



The middle matrix is diagonal. Let us look first at the terms coming from 
the diagonal entries in the first and third matrix. They give 



I//i(A) 



1) 



(2vr) 2 
1 



(£ 2 + r 2 ) Ti(f +t 2 + A)-2- 2 dTd£d9 



S 1 xl 



Tr(£ 2 + r 2 + A)- 



r-l 



drd£d6 



S 1 xl 



(2vr) 2 

(20) = -JLJ Tr(A-$)d0. 

Finally let us compute the contribution coming from anti-diagonal entries: 
i{\ + 2) 



ii hW 



(2nf 



S 1 xl 



(21) 



Tr (L>*(£ 2 + r 2 + DD*)-2- 2 V dg (D) 
Tr ( D{i 2 + r 2 + D*D)-^- 2 V dg {D*)^ drd^dO 
TT(p*{DD*)-^- l V dB {D)) 
- Tr [D{D*D)-^- 1 V dg {D*)Yj d6 



i 

4tt 



The terms (17), (|T8|), ( |19| ) and ( po| ) cancel so Proposition 1C follows from 
(pTJ) specialized at A = and from (S). □ 



By Theorem g the quantity computed in Proposition 16 equals half the 
adiabatic limit (the limit as x tends to 0) of the eta invariant of the family S x . 
To complete the proof of the index Theorem || we must show the integrability 
of the index density. 
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Proposition 17. Under the assumptions of Theorem ||, the local index den- 
sity tr(ri(0) — ^2(0)) is a smooth multiple of 1/x. Moreover, 

lim / tr(ri(0) - r 2 (0)) 

ixn{ai>E} 

exists and gives the AS term in the index formula without regularization 
with x z . 



Proof. By Corollary || we know that 

1 



(22) 



trfo(0)) 



J x^0 



(2*) S 



tvq(RJ x )d£dT 



dOdx 



has a Laurent expansion at x = with a possible singularity of order 3. Thus 
we first want to show that the coefficients of x -3 , x~ 2 in tr(ri(0)) — tr(r2(0)) 
vanish. We caution the reader that the products in this proof are with 
respect to the rule @. Since tr is invariant under conjugation by linear 
isomorphisms, we can replace the operator U near x = with 



P 



{x 2 d x - |)I 2 + S X . 



We have 



q(PP*) 
q(P*P) 



t 2 + + \ +q{5 2 x ) + XT 



-1 
1 

-1 
1 



From this we see that q(PP*)~ x = q(P*P)~ x modulo x, and that 
(q(PP*)~ x — g(P*P) _A )[_ 1 ] is odd in r hence vanishes after integration. 
Therefore (|2^) proves the first part of the theorem. 



Let us now examine the integral on dX of the coefficient of x 1 in the index 
density. By (22) this is 



/ 



Tr(g(PP*)~ A - q(P*P)- x ) { _ 2] dTd£d6 



xS 1 



We cannot give an explicit formula for (q(PP*)~ x — Q , (P*P)~ A )[-2] ; but we 
can do it for its trace. We proceed as in the proof of Proposition 16 to 
eliminate the terms odd in r or £. We are left with 



Jr 



"I (-1-1) 



■xS 1 



Tr 



-1 
1 



V ae (A)(£ 2 + T 2 + A)- 



didrdO 
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(coming from the composition of xr 



-1 
1 



with (£ 2 -r-T 2 + A)~2 _1 ) and 



Jr 



'■xS 1 



i) (- 



Tr -x 2 2t 2 








1 



V 9e (A)(^ + r 2 + A)-2- 3 )dSdTdB 



(coming from (£ 2 + r 2 + )• Integration by parts with respect to 

r in the second term gives the negative of the first term. Note that this 
canceling occurs before the integration in 9. Both terms are actually after 
integration in all variables. □ 

Note that we proved slightly more than we claimed, namely that the fiber- 
wise integral of the index density is smooth as a density in x, 6. It seems 
reasonable to ask if the index density itself is smooth down to x = (as in 
the case of Dirac operators), however we were unable to prove or to disprove 
this fact. 
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